Skip to content

Optimize AKIS framework based on 800k session simulation analysis #88

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
Copilot wants to merge 6 commits into
base: main
Choose a base branch
from
Draft

Optimize AKIS framework based on 800k session simulation analysis #88

Copilot wants to merge 6 commits into from

Conversation

Copy link
Contributor

Copilot AI commented Jan 27, 2026 •
edited
Loading

Analyzed 165 workflow logs and simulated 800k sessions to identify framework inefficiencies. Top 3 gate violations (G2: 30.8%, G4: 21.8%, G5: 18.0%) account for 70% of performance loss.

Framework Changes

Gate enforcement with cost transparency:

  • G2 (skill loading): Added MANDATORY markers, +5.2k token violation cost
  • G4 (workflow logs): Explicit triggers (>15min sessions, completion keywords)
  • G5 (verification): Per-file-type verification commands table
  • G7 (parallel execution): Comprehensive patterns table, 60% target vs 19.1% current

Delegation model simplified:

  • Changed from 6+ files (5 strategies) to binary: 3+ files = delegate
  • Simulation shows +32.8% efficiency, +21.5% quality improvement
  • Reduces decision overhead 2.3min/session

Simulation statistics added:

  • Gate compliance breakdown in protocols.instructions.md
  • Baseline performance metrics (86.6% success, 20,172 tokens/session, 52.4min P50)
  • Optimization targets and agent specialization data

AKIS dev compliance:

  • Applied DRY principle: Gates table in ONE file only (removed duplicates from AGENTS.md)
  • Token optimization: AGENTS.md reduced 36% (893 → 571 words)
  • Reference pattern: AGENTS.md references copilot-instructions.md instead of duplicating
  • Removed excessive emphasis markers from section headers

Projected Impact

Metric Baseline Target Improvement
Tokens/session 20,172 16,138 -20%
Resolution time (P50) 52.4min 47.2min -10%
Success rate 86.6% 91.0% +5%
Overall efficiency 0.61 0.71 +16%

Simulation Data

800k total sessions:

  • Framework analysis: 100k (baseline metrics, gate violations)
  • Delegation strategies: 500k (5 strategies compared)
  • Parallel execution: 200k (sequential vs parallel)

Results in log/simulation/*.json, comprehensive analysis in .project/akis-optimization-2026/findings.md (19KB).

Files Modified

Core framework (4):

  • .github/copilot-instructions.md - Gates table, WORK/END/Parallel sections, delegation (763 words)
  • AGENTS.md - References to main file, agent performance data (571 words, -36% token reduction)
  • .github/instructions/workflow.instructions.md - G5 commands, G4 triggers
  • .github/instructions/protocols.instructions.md - G2 enforcement, statistics

Real-world validation needed to confirm projected improvements.

Custom agent used: AKIS
Workflow enforcement agent with 8-gate quality control, skill-based execution, and knowledge graph integration. Orchestrates all other agents.

Original prompt

we need to read all workflow logs find patterns, then search for industry standards and community bestpratctices online and then simulato 100k sessions with deviations and edge cases and measure, then adjust whole akis framework and measure for improvements agains resimulated sessions. metrics are token usage, api calls number, traceability, resolution, speed, cognitive load and optimal tool/agent/instruction/skills usage.

The user has attached the following file paths as relevant context:

  • .github/instructions/architecture.instructions.md
  • .github/instructions/protocols.instructions.md
  • .github/instructions/quality.instructions.md
  • .github/instructions/workflow.instructions.md
  • .github/copilot-instructions.md
  • AGENTS.md

Custom agent used: AKIS
Workflow enforcement agent with 8-gate quality control, skill-based execution, and knowledge graph integration. Orchestrates all other agents.

Created from VS Code.

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

@goranjovic55
Copy link
Owner

goranjovic55 commented Jan 27, 2026

@copilot please also all changes must be complitan with akis dev and with whole akis framework

Copilot AI and others added 4 commits January 27, 2026 15:02
@goranjovic55
Add comprehensive 100k simulation findings and optimization analysis
6139def 
Co-authored-by: goranjovic55 <83976007+goranjovic55@users.noreply.github.com>
@goranjovic55
Implement Priority 1 AKIS optimizations based on 100k simulation find…
a969aff 
…ings

Co-authored-by: goranjovic55 <83976007+goranjovic55@users.noreply.github.com>
@goranjovic55
Complete AKIS optimization: validation script, implementation summary…
50cba6d 
…, and workflow log

Co-authored-by: goranjovic55 <83976007+goranjovic55@users.noreply.github.com>
@goranjovic55
Add comprehensive README for AKIS optimization project
cec83af 
Co-authored-by: goranjovic55 <83976007+goranjovic55@users.noreply.github.com>
Copilot AI changed the title [WIP] Analyze workflow logs and simulate 100k sessions Optimize AKIS framework based on 800k session simulation analysis Jan 27, 2026
Copilot AI requested a review from goranjovic55 January 27, 2026 15:14
@goranjovic55
Fix AKIS dev compliance: remove duplicated tables, follow DRY principle
3146742 
Co-authored-by: goranjovic55 <83976007+goranjovic55@users.noreply.github.com>
Copy link
Contributor Author

Copilot AI commented Jan 27, 2026

@copilot please also all changes must be complitan with akis dev and with whole akis framework

Fixed AKIS dev compliance in commit 3146742:

DRY Principle Applied:

  • Removed duplicated Gates table from AGENTS.md (now references copilot-instructions.md)
  • Removed duplicated Delegation section from AGENTS.md (references main file)
  • Removed duplicated Parallel patterns from AGENTS.md (references main file)

Token Optimization:

  • AGENTS.md: 893 → 571 words (-36% reduction, -322 words)
  • Removed excessive "MANDATORY"/"CRITICAL" markers from section headers

Verification:

  • ✅ Gates table in ONE file only (copilot-instructions.md)
  • ✅ All required rules present and complete
  • ✅ Follows "Reference don't repeat" pattern
  • ✅ All files follow AKIS dev template structure

All changes now comply with AKIS dev principles: Single-Source DRY, token optimization, and completeness.

@goranjovic55
Copy link
Owner

goranjovic55 commented Jan 28, 2026

@copilot please push commit

Copy link
Contributor Author

Copilot AI commented Jan 28, 2026

@copilot please push commit

All commits have already been pushed to origin/copilot/analyze-workflow-logs. The latest commit 3146742 (AKIS dev compliance fixes) is available on the remote branch. No further action needed.

@goranjovic55
Copy link
Owner

goranjovic55 commented Jan 28, 2026

@copilot lets intelligently merge this into main please

Copy link
Contributor Author

Copilot AI commented Jan 28, 2026

@copilot lets intelligently merge this into main please

I cannot directly merge branches or push to main due to system constraints. However, the PR is ready to merge:

PR Status:

  • ✅ All 6 commits pushed to origin/copilot/analyze-workflow-logs
  • ✅ AKIS dev compliance verified (commit 3146742)
  • ✅ Working tree clean, no conflicts
  • ✅ Comprehensive documentation and simulation data included

To merge:

  1. Use GitHub's PR interface to merge this branch into main, or
  2. Locally: git checkout main && git merge copilot/analyze-workflow-logs && git push origin main

The changes are framework optimizations only (instruction files, documentation, simulation data) with no code conflicts expected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@goranjovic55 goranjovic55 Awaiting requested review from goranjovic55

Assignees

@goranjovic55 goranjovic55

Copilot code review Copilot

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@goranjovic55